Faster Inference (How to process faster)

[vineeth9059]

How to increase GPU utilization and Reduce Runtime,

In my case I'm Running this project on NVIDIA RTX A4000 with 16GB GPU, CUDA Version: 12.4, Driver Version: 550.127.08

I have Tried source image and Driving video

Driving video is of 9 seconds, with 24 fps, (216 frames) with audio as well (512 X 512) video resolutions

So, the Total Execution Time for this is 15-17 seconds with less than 3GB GPU, I want to Increase the GPU Utilization and Reduce the Runtime, is there any possibility to do it.